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SUMMARY 


A.  Problem 


In  the  past  few  years,  the  NR0TC  (Regular)  midshipmen  have  been 
voluntarily  disenrolling  from  the  program  in  increasing  numbers.  The 
increasing  disenrollment  rate  results  in  fewer  midshipmen  receiving 
commissions  and  reduces  the  pool  of  potential  career  officers.  This, 
coupled  with  the  substantial  monetary  loss  when  a  midshipman  disenrolls, 
requires  the  selection  of  those  applicants  most  likely  to  remain  in 
training  and  elect  a  naval  career. 

B.  Background 

Since  1964,  the  Strong  Vocational  Interest  Blank  (SVIB)  has  been 
routinely  administered  to  all  applicants  for  an  NR0TC  (Regular) 
scholarship  as  a  means  of  identifying  those  who  are  career  motivated. 

The  success  of  this  effort  suggested  possible  use  of  the  SVIB  as  a  means 
of  predicting  completion  of  NR0TC  college  training. 

C.  Approach 

Using  data  from  the  entering  classes  for  the  years  1964-1967,  several 
scales  were  constructed  by  contrasting  the  SVIB  responses  of  midshipmen 
remaining  in  the  program  with  those  disenrolling  for  various  reasons 
(motivational,  academic,  etc.).  These  scales  were  evaluated  on  a 
similarly  constituted  holdout  sample. 

D.  Findings,  Conclusions,  and  Recommendations 

A  cross-validated  biserial  validity  coefficient  of  .20  was  obtained 
for  the  best  empirical  scale  between  disenrollment  for  any  reason  and 
remaining  in  the  program  (page  5).  Under  favorable  conditions,  this 
scale  could  eliminate  80  potential  disenrollees  from  a  starting  class 
of  1,350  midshipmen  (page  5).  Such  a  decrease  in  attrition  could 
produce  a  monetary  saving  of  approximately  $300,000  per  year  (page  10). 

To  determine  the  actual  contribution  that  use  of  the  SVIB  would  make, 
the  relationships  between  the  disenrollment  scale  and  present  selection 
scores  are  being  determined.  This  analysis  will  permit  recommendations 
to  be  made  for  the  operational  use  of  the  disenrollment  scale. 
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B.  Background 

Since  1964,  the  Strong  Vocational  Interest  Blank  (SVIB)  has  been 
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scholarship  as  a  means  of  identifying  those  who  are  career  motivated. 

The  success  of  this  effort  suggested  possible  use  of  the  SVIB  as  a  means 
of  predicting  completion  of  NROTC  college  training. 
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Using  data  from  the  entering  clashes  for  the  years  1964-1967,  several 
scales  were  constructed  by  contrasting  the  SVIB  responses  of  midshipmen 
remaining  in  the  program  with  those  disenrolling  for  various  reasons 
(motivational,  academic,  etc.).  These  scales  were  evaluated  on  a 
similarly  constituted  holdout  sample. 

D.  Findings,  Conclusions ,  and  Recommendations 

A  cross-validated  biserial  validity  coefficient  of  .20  was  obtained 
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THE  DEVELOPMENT  OF  AN  SVIB  SCALE  FOR  PREDICTING  DISENROLLMF.NT 
FROM  THE  NROTC  (REGULAR)  PROGRAM 


A.  BACKGROUND  AND  PURPOSE 

Since  1964,  the  Strong  Vocational  Interest  Blank  (SVIB)  has  been 
routinely  administered  to  all  applicants  for  a  Naval  Reserve  Officers 
Training  Corps  (NROTC)  Regular  scholarship.  An  empirically  derived 
scale  for  predicting  retention  has  been  used  in  selection  of  scholarship 
applicants  since  1965  (Abrahams,  Neumann,  5  Githens,  1968).  As  favorable 
validity  evidence  has  accumulated,  the  scale  has  been  given  increasing 
weight  in  the  selection  decisions.  Even  though  this  scale  was  originally 
designed  only  to  predict  post-commissioning  tenure,  it  was  also  found  to 
discriminate  very  significantly  between  differentially  motivated  mid¬ 
shipman  groups  during  NROTC  training.  That  is,  the  NPOTC  midshipmen 
who  transferred  to  the  Naval  Academy  obtained  the  highest  scores,  the 
midshipmen  dropping  at  their  own  request  obtained  the  lowest  scores, 
with  the  remaining  midshipmen  obtaining  intermediate  scores.  These 
results  suggested  that  a  special  scale  could  be  constructed  to  predict 
program  completion  with  even  greater  efficiency.  And,  since  the  disen- 
rollment  rate  in  recent  years  has  been  high,  an  effective  disenrollmcnt 
scale  would  be  highly  desirable.  The  purpose  of  this  renort  is  to 
describe  the  procedures  followed  in  constructing  such  a  scale  and  to 
present  the  relevant  validity  information  available  at  this  time. 

The  relationships  between  the  disenrollmcnt  scale  and  the  presently 
used  selection  variables  (the  Naw  College  Aptituui  Test  (NCAT) ,  High 
School  Rank  (HSR),  the  Strong,  Vocational  Interest  Blank/Background 
Questionnaire  (SVIB/BQ)  officer  retention  score,  and  the  Interview 
Rating)  are  being  investigated  and  will  be  presented  in  a  subsequent 
report. 


B.  POPULATION  AND  CR IT!  RIOS' 

The  scholarship  selectees  included  in  these  analyses  completed  the 
S\ IB  at  the  tine  of  application  in  the  years  1964-1967,  inclusive,  and 
subsequently  enrolled  in  the  NROTC  program.  Data  from  the  more  recent 
years  could  not  be  used  since  a  sufficient  time  had  not  elapsed  f*  i  the 
necessary  Identification  of  disenroiled  and  remaining  midshipmen. 

In  \oveaber  1969,  both  the  NROTC  Hester  Active  and  Attrition  tanes 
were  searched  to  obtain  disenrollment  information.  Table  I  presents  the 
number  of  midshipmen  by  criterion  statu*  and  year  for  whom  S\IB  response* 
were  readily  available.  In  the  discussion  that  follows,  classes  will  he 
referred  to  In  tens*  of  the  year  in  which  the  N\ IB  was  administered. 
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TABLE  1 


Numbers  of  Selected  NROTC  Applicants  by  Criterion 
Status  and  Year  Tested 


Criterion 

Year 

in  which  SVIB 

was  administered 

Status3 

1964 

1965  ' 

1966 

1967 

Totals 

HIGH 

Remaining  Class 

35 

272 

228b 

1012 

1547 

Commissioned  Officers 

680 

751 

25 

11 

1467 

Academy  Transfers 

12 

14 

22 

20 

68 

Total 

727 

1037 

275 

1043 

3082 

LOW  (Disenrollees) 

Motivational 

185 

158 

291 

386 

1020 

Academic 

190 

246 

235 

156 

827 

Others 

111 

123 

58 

55 

347 

Total 

486 

527 

584 

m  m  m 

597 

•  •  •  m 

2194 

Total  Sample 

1213 

1564 

859 

1640 

'276 

NotC.-- 


"Criterlon  status  was  obtained  in  Novcafcer  I960. 

SVII  answer  sheets  for  1966  testing  were  not  mchine  processable. 
Since  Kinual  key "punching  was  costly  and  t l »e- cons using,  all  disenrollees 
were  included  but  only  a  sample  of  the  reraininr  class  was  used. 


C.  INSTRUMENT 


The  1964  edition  of  the  SVIB,  containing  405  items,  was  used  in  the 
years  1964,  1965,  and  1966.  Use  of  the  1966  revised  edition  was  begun 
in  1967.  This  change  necessitated  limiting  the  items  available  for 
analysis  to  those  which  were  either  unchanged  or  altered  only  slightly. 
A  total  of  368  items  met  these  standards  and,  with  three  possible 
responses  provided  for  each  item,  a  pool  of  1,104  item  responses  was 
available  for  analyses. 


D.  PROCEDURE 


1 .  Preliminary  Analyses 

TVo  preliminc  •  analyses  were  necessary  prior  to  key  development. 
First,  it  seemed  essential  to  examine  SVIB  Basic  Scale  profile  before 
combining  year  groups  to  ensure  that  the  four  classes  were  similar 
enough  to  be  combined.  Since  no  two  classes  differed  by  more  than  two 
standard  score  points  and  two  point  differences  occurred  on  only  three 
scales,  it  seemed  reasonable  to  combine  the  four  year  groups  into  a 
single  sample.  Second,  since  the  criterion  data  were  collected  in 
November  1969,  some  of  the  midshipmen  remaining  at  that  time  would 
ultimately  disenroll.  Thus,  potential  drops  would  contaminate  the 
"remaining  class"  criterion  and  reduce  the  discriminating  power  of  the 
scale.  However,  if  it  were  known  that  the  majority  of  disenrollees  had 
already  left,  the  remaining  class  could  be  used  in  the  high  criterion 
group  with  greater  confidence. 

To  examine  this  question,  distributions  of  disenrol lment  dates  for 
the  academic,  motivational,  and  other  disenrollees  of  the  1964  class 
were  prepared.  The  proportions  of  disenrollees  were  computed  at  various 
points  along  the  disenrol lment  date  distributions.  In  this  way,  it  was 
possible  to  determine,  at  any  point  in  tine,  what  proportion  of  the 
total  of  each  type  of  discnrollmcnt  had  already  occurred.  Using  these 
distributions  to  project  for  the  most  recent  class,  it  was  estimated 
that  by  November  1969,  77  per  cent  of  the  academic  and  89  per  cent  of 
the  motivational  disenrollments  of  the  1967  class  had  already  occurred. 
Again,  using  the  1964  class  for  such  projections,  it  was  estimated  that 
89  per  cent  of  the  1967  class  remaining  as  of  November  1969  would- 
complete  the  program.  Of  the  11  per  cent  estimated  disenrollees,  it 
was  expected  that  2.4  per  cent  would  disenroll  for  motivational  reasons, 
S.3  per  cent  for  academic  reasons,  and  the  remaining  3.3  per  cent  for 
miscellaneous  reasons,  such  as  inaptitude,  disciplinary,  or  physical. 
These  results  supported  the  inclusion  of  the  1967  remaining  class  in 
the  high  criterion  group.  Since  an  even  greater  portion  of  the  eventual 
drops  for  the  196S  and  1966  classes  could  be  assumed  to  have  already 
disenrolled,  it  clearly  follows  that  their  remaining  classes  also  meet 
the  requirements  for  inclusion  in  the  high  criterion  sample. 
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2.  Key  Construction  ami  Validation 

The  entire  sample  was  split  into  equal  subsamples,  stratified  by 
disenrol lment  and  high  criterion  categories,  for  key  construction  and 
cross-validation  purposes.  Three  experimental  scales  were  constructed 
on  the  key- construction  samples  by  contrasting  the  responses  of  each 
of  the  three  disenrol lment  groups  with  the  responses  of  the  high 
criterion  group,  which  consisted  of  all  those  who  had  either  received 
their  commissions  or  who  were  so  advanced  in  the  program  that  they  had 
an  extremely  high  likelihood  of  completing  the  program.  Since  the  sample 
sizes  were  quite  large,  item  responses  with  a  seven  per  cent  or  greater 
difference  were  included  in  each  of  the  three  experimental  scales. 
Validities  were  obtained  on  the  cross-validation  samples,  and  for  those 
scales  showing  the  most  promise,  expectancy  charts  were  constructed  in 
which  the  frequencies  were  adjusted  to  reflect  present  disenrollment 
rates.  In  addition,  dollar  savings  were  computed  based  on  the  expected 
reduction  in  number  of  disenrollees,  under  various  selection  ratios. 


E.  RESULTS  AND  DISCUSSION 

A  number  of  experimental  scales  were  constructed  and  evaluated  to 
obtain  the  predictive  measure  that  best  differentiated  between  disen¬ 
rol  lees  (for  any  reason)  and  remaining  midshipmen  (almost  half  of  whom 
had  already  received  their  commissions).  Using  one  half  of  each  criterion 
group  for  key  construction,  the  following  scales  were  obtained  with  the 
same  half  of  the  high  criterion  group  in  each  case  but  with  different  low 
criterion  samples: 

(1)  Motivational .  The  item  responses  for  midshipmen  who  voluntarily 
disenrol led  from  the  program  were  contrasted  with  those  of  the  high 
criterion  group,  resulting  in  a  scale  of  47  item  responses  having  a 
seven  per  cent  or  greater  difference  between  the  criterion  groups. 

(2)  Academic.  Midshipmen  who  were  disenrol lej  for  academic  reasons 
comprised  the  low  criterion  sample  for  this  scale.  In  this  instance,  a 
total  of  28  i’-cm  responses  were  identified  that  met  the  seven  per  cent 
or  greater  criterion  for  item  selection. 

(3)  All  Disenrollees .  A  scale  intended  to  be  useful  in  predicting 
any  type  of  disenrollment  (irrespective  of  reason)  was  developed  by 
using  a  low  criterion  group  consisting  of  all  types  of  disenrollees. 

Due  to  the  heterogeneity  of  this  grouping,  only  10  items  met  the  seven 
per  cent  criterion. 

(4)  Motivational -Academic.  Since  the  motivational  and  academic  drops 
represented  the  largest  portion  of  the  total  disenrollment  sample,  the 
final  experimental  key  simply  combined  the  items  from  the  Motivational 
and  Academic  scales.  Three  item  responses  were  common  to  both  scales 
and  one  item  response,  keyed  in  opposite  directions,  was  dropped, 
resulting  in  a  combined  scale  of  70  item  responses. 
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Tabic  2  presents  the  Beans,  standard  deviations,  and  biscriai 
validity  coefficients  for  various  disenrol lment  categories  on  the  holdout 
samples.  The  level  of  significance  is  presented  for  each  of  the  biscriai 
validity  coefficients  (Alf  6  Abrahams,  in  press).  Mnee  eight  of  the  12 
comparisons  between  the  remaining  class  and  various  disenro! lwent 
categories  were  significant  beyond  the  .01  level,  it  ra\  be  concluded 
that  the  SVIB  can  be  used  to  identify  applicants  likely  to  disenro! I 
from  the  NROTC  program. 

the  Motivational  and  the  Mot ivat ional- Academic  scales  are  the 
most  predictive  when  all  disenrollees  are  considered  as  a  group 
(r^  «  .20).  As  expected,  the  Motivational  Scale  rovides  the  best 

discrimination  between  those  who  voluntarily  disenroll  and  those  who 
remain  in  the  program  (r^  ■  .24).  In  contrast  to  its  relatively  high 

validity  for  predicting  motivational  disenrol lment ,  this  scale  does  the 
poorest  job  of  identifying  academic  drops  (r  ■  .05).  Although  the 
Academic  Scale  is  most  valid  for  academic  drops  (r^  •  .17),  it  cannot 

be  used  to  identify  motivational  drops  (r^  ■  .02).  However,  the  combined 

Motivational-Academic  Scale  provides  an  acceptable  compromise  between  the 
individual  scales,  with  no  loss  in  validity  when  all  the  disenrollees  are 
combined  (r^  ■  .20).  The  All  Disenrol lee  Scale  is  only  sllghtlv  less 

predictive  than  the  Motivational-Academic  Scale,  but,  because  of  the 
shortness  (only  10  item  responses),  use  of  this  scale  seems  inadvisable. 

To  provide  additional  decision-making  information  and  to  assess 
the  practical  advantages  of  using  one  of  these  experimental  scales  for 
selection  purposes,  expectancy  charts  were  constructed,  figures  I  and  2 
present  the  percentage  of  all  disenrollees  one  could  expect  in  various 
score  categories  for  the  Motivational,  and  the  Mot ivat ional -Academic 
scales,  respectively.  Comparing  the  two  charts,  there  seems  to  be  only 
a  negligible  difference  in  the  two  top  score  categories.  However,  the 
remaining  three  score  categories  seem  to  favor  the  use  of  the  Motivational- 
Academic  Scale.  To  provide  a  better  basis  for  choosing  between  the  two 
scales,  further  comparisons  were  made  by  determining  the  consequences  of 
using  each  scale  and  of  using  no  scale  at  all,  under  various  selection 
ratios  (see  Table  3).  For  example,  if  it  were  necessary  to  select  the 
top  60  per  cent  from  a  pool  of  qualified  applicants,  one  could  expect 
to  iminate  80  more  disenrollees  by  using  the  Motivat loral-Acaderic 
Sea  it*  than  with  no  SV1R  scale  at  all.  A  savings  of  54  disenrollees 
would  result  if  the  Motivational  Scale  were  used.  The  additional 
savings  of  26  disenrol lments  demonstrates  the  superiority  of  the  combined 
scale. 


Although  the  exact  cost  of  commissioning  an  officer  through  the 
NROTC  (Regular)  program  varies  from  school  to  school,  it  has  been 
estimated  at  somewhere  between  $10,000  and  $12,000  ner  ran,  or  approxi¬ 
mately  $2,500  -  $3,000  per  school  year.  If  one  were  to  assume  that  of 
the  80  men  potentially  retained  by  using  the  Mot ivat ional-Acadcmic 
Scale,  approximately  one-half  might  have  left  sometime  during  their 
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Ft*.  2.  Expectance  chart  for  all  due*  roller*  on  the  WTC  tfematlooal*  Wadcwic  Vale 
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first  rear  In  (hr  pr grass  and  (hr  rmiKinf  half  »  «r%Srrr  during  and 
InoaJ  (hr  second  year.  This  results  In  an  estimated  saving  of 
jfprosimntely  1)00,060  per  f«r.  M(h  a  aorr  favorable  srlrcdon  ratio, 
(hr  yearly  sayings  w  uld  hr  considerably  greater. 

At  previously  stated,  analysis  of  (hr  rrlationthlp  between  the 
dlsenrol  I *ent  scale  and  the  present  selection  tcoret  la  underway.  This 
analysis  will  permit  recomarndat »ont  to  be  made  for  the  operational  use 
of  the  dlsenrol  Iment  scale 


l.  vaoimj  cowLlusiJhS 

Ongoing  rrtrarch  hat  established  the  validity  of  the  SMB  in 
assessing  it  tit  at  Ion  for  a  career  at  a  Savy  officer.  The  success  of  the 
oriental  s\IB  let,  which  was  constructed  by  using  career  decisions  of 
comml tt lotted  officers  at  a  criterion,  suggested  that  a  special  scale 
could  be  desetoped  to  Improve  prediction  of  pre -coaMissloning  attrition 
lit  the  \%IU  profran  Because  of  the  Increasingly  high  dlsenrol lncnt 
rates  and  the  need  to  identify  such  disenrollees  becane  no  re  iaportant, 
such  a  scale  was  constructed  on  data  front  S'hOTC  classes  1904-1967 

%  cross- validated  blserlal  validity  coefficient  of  .70  for  this 
rapt  rival  scale  was  obtained  between  dlsenrol  Inent  for  any  reason  and 
remaining  In  the  prof  ran  Assuming  that  the  scale  could  be  applied  to 
appli  cants  qualifying  on  other  selection  variables  with  a  selection  ratio 
af  60,  it  was  estimated  that  BO  potential  disenrollees  could  be 
eliminated  from  a  starting  class  of  1,JS0  nldshlpnen  through  use  of 
the  new  scale.  VKh  a  decrease  in  attrition  would  produce  a  nonet  ary 
saying  of  approsinstely  fJOO.OOO  per  year. 

The  potential  benefits  of  adding  this  dlsenrol Inent  scale  to  the 
pres  erf  |y  used  sr  lection  \anables  are  currently  being  investigated. 

**|vn  txopletion  of  these  analyses,  recoaasendations  will  be  nade  for 
Incorporating  the  new  scale  Into  the  ope*ationsl  selection  pro gran. 
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Washington,  D.  C.  20370 


n  the  past  few  years,  the  NROTC  (Regular)  midshipmen  have  been  voluntarily 
disenrolling  from  the  program  in  increasing  numbers.  The  increasing  discnrol lment 
rate  results  in  fewer  midshipmen  receiving  commissions  and  reduces  the  pool  of 
potential  career  officers.  This,  coupled  with  the  substantial  monetary  loss  when  a 
midshipman  discnrolls,  requires  the  selection  of  those  applicants  most  likely  to 
remain  in  training  and  elect  a  naval  career. 

Since  1964,  the  Strong  Vocational  Interest  Blank  (SVIB)  has  been  routinely  adminis¬ 
tered  to  all  applicants  for  an  NROTC  (Regular)  scholarship  as  a  means  of  identifying 
those  who  are  career  motivated.  The  success  of  this  effort  suggested  possible  use  of 
the  SVIB  as  a  means  of  predicting  completion  of  NROTC  college  training. 

Using  data  from  the  entering  classes  for  the  years  1964-1967,  several  scales  were 
constructed  by  contrasting  the  SUB  responses  of  midshipmen  remaining  in  the  program 
with  those  disenrolling  for  various  reasons  (motivational,  academic,  etc.).  These 
scales  were  evaluated  on  a  similarly  constituted  holdout  sample. 

A  cross-val idated  biscrial  validity  coefficient  of  .20  was  obtained  for  the  best 
empirical  scale  between  dlsenrol lment  for  any  reason  and  remaining  in  the  program. 
Under  favorable  conditions,  this  scale  could  eliminate  80  potential  disenrollces  from 
a  starting  class  of  1,350  midshipmen.  Such  a  decrease  in  attrition  could  produce  a 
monetary  saving  of  approximately  $300,000  per  year. 

To  determine  the  actual  contribution  use  of  the  SVIB  would  make,  it  is  recommended 
that  the  relationship  between  the  discnrol  lment  scale  and  the  present  selection  scores 
he  determined.  This  analysis  will  permit  recommendations  to  be  made  for  the 
operational  use  of  the  disenrol lment  scale. 
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